Generalization of the de Bruijn's identity to general $\phi$-entropies and $\phi$-Fisher informations
نویسندگان
چکیده
In this paper, we propose generalizations of the de Bruijn’s identities based on extensions of the Shannon entropy, Fisher information and their associated divergences or relative measures. The foundation of these generalizations are the φ-entropies and divergences of the Csiszár’s class (or Salicrú’s class) considered within a multidimensional context, included the monodimensional case, and for several type of noisy channels characterized by a more general probability distribution beyond the well-known Gaussian noise. It is found that the gradient and/or the hessian of these entropies or divergences with respect to the noise parameters give naturally rise to generalized versions of the Fisher information or divergence, which are named as the φ-Fisher information (divergence). The obtained identities can be viewed as further extensions of the classical de Bruijn’s identity. Analogously, it is shown that a similar relation holds between the φ-divergence and a extended mean-square error, named φ-mean square error, for the Gaussian channel.
منابع مشابه
deBruijn identities: from Shannon, Kullback–Leibler and Fisher to generalized φ -entropies, φ -divergences and φ -Fisher informations
In this paper we propose a generalization of the usual deBruijn identity that links the Shannon differential entropy (or the Kullback–Leibler divergence) and the Fisher information (or the Fisher divergence) of the output of a Gaussian channel. The generalization makes use of φ -entropies on the one hand, and of φ -divergences (of the Csizàr class) on the other hand, as generalizations of the S...
متن کاملphi-Amenable and phi-biflat Banach algebras
In this paper we study the concept of ph-biatness ofa Banach algebra A, where ph is a continuous homomorphism on A.We prove that if ph is a continuous epimorphism on A and A hasa bounded approximate identity and A is ph- biat, then A is ph-amenable. In the case where ph is an isomorphism on A we showthat the ph- amenability of A implies its ph-biatness.
متن کاملNew Integral Inequalities Through the phi-Preinvexity
Abstract. In this note, we give some estimates of the generalized quadrature formula of Gauss-Jacobi type for phi-preinvex functions.
متن کاملSome remarks on generalizations of classical prime submodules
Let $R$ be a commutative ring with identity and $M$ be a unitary $R$-module. Suppose that $phi:S(M)rightarrow S(M)cup lbraceemptysetrbrace$ be a function where $S(M)$ is the set of all submodules of $M$. A proper submodule $N$ of $M$ is called an $(n-1, n)$-$phi$-classical prime submodule, if whenever $r_{1},ldots,r_{n-1}in R$ and $min M$ with $r_{1}ldots r_{n-1}min Nsetminusphi(N)$, then $r_{1...
متن کاملϕ-ALMOST DEDEKIND RINGS AND $\Phi$-ALMOST DEDEKIND MODULES
The purpose of this paper is to introduce some new classes of rings and modules that are closely related to the classes of almost Dedekind domains and almost Dedekind modules. We introduce the concepts of $\phi$-almost Dedekind rings and $\Phi$-almost Dedekind modules and study some properties of this classes. In this paper we get some equivalent conditions for $\phi$-almost Dedekind rings and ...
متن کامل